Image processing device to execute communication processing with information processing device, non-transitory computer-readable recording medium for image processing device, and image processing system

ABSTRACT

An image processing device may display a first display screen including a first image on a touch screen. The first image may be for accepting a display switching instruction to switch the first display screen to a second display screen. The image processing device may generate first screen data which enables a display of the information processing device to display the first display screen. The image processing device may send the generated first screen data in a case where first request information is received from the information processing device. The image processing device may receive coordinate information indicating a position within the first display screen where an input operation has been inputted. The image processing device may switch to the second display screen associated with the first image in a case where the position indicated by the coordinate information is within the display area of the first image.

TECHNICAL FIELD

The technique disclosed herein relates to an image processing deviceconfigured to display various images.

BACKGROUND

A system that controls an image processing device using an informationprocessing device by remote control is known. In this system, theinformation processing device displays an operation screen received fromthe image processing device on its display, accepts operations inputtedby a user according to the operation screen, and sends instructionscorresponding to the inputted operation to the image processing device.The image processing device displays a screen corresponding to theinstruction received from the information processing device.

SUMMARY

To realize a remote control system, a program for communicating varioustypes of commands dedicated to remote control needs to be stored in amemory of an image processing device. When a size of this program islarge with respect to a memory capacity of the image processing device,much of the memory capacity may be occupied by this program.

One technique disclosed in the present application is an imageprocessing device. The image processing device may comprises: acommunication interface for executing communication with an informationprocessing device; a touch screen; a memory storing computer-readableinstructions; and a controller. The computer-readable instructions, whenexecuted by the controller, may cause the image processing device toperform displaying a first display screen including a first image on thetouch screen. The first image may be an image for accepting an input ofa display switching instruction to switch the first display screen to asecond display screen. The computer-readable instructions may cause theimage processing device to perform generating first screen data, whichrepresents the first display screen displayed in the displaying, andwhich enables a display of the information processing device to displaythe first display screen. The computer-readable instructions may causethe image processing device to perform sending the generated firstscreen data to the information processing device via the communicationinterface in a case where first request information is received via thecommunication interface from the information processing device. Thecomputer-readable instructions may cause the image processing device toperform receiving coordinate information via the communication interfacefrom the information processing device. The coordinate information mayindicate a position within the first display screen where an inputoperation has been inputted. The computer-readable instructions maycause the image processing device to perform determining whether or notthe position indicated by the coordinate information is within a displayarea of the first image. The computer-readable instructions may causethe image processing device to perform switching to the second displayscreen associated with the first image in a case where the positionindicated by the coordinate information is within the display area ofthe first image.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram showing an electric configuration of an imageprocessing system 1;

FIG. 2 is a flow chart showing an operation of an MFP 10;

FIG. 3 is a flow chart showing S20 of FIG. 2, which is a part of theoperation of the MFP 10;

FIG. 4 is a flow chart showing S40 of FIG. 2, which is a part of theoperation of the MFP 10;

FIG. 5 is a flow chart showing S60 of FIG. 2, which is a part of theoperation of the MFP 10;

FIG. 6 is a flow chart showing S80 of FIG. 2, which is a part of theoperation of the MFP 10;

FIG. 7 is a flow chart showing S100 of FIG. 2, which is a part of theoperation of the MFP 10;

FIG. 8 is a flow chart showing an operation of a terminal 200;

FIG. 9 is a flow chart showing a part of the operation of the terminal200 (continued from FIG. 8);

FIG. 10 is a flow chart showing S830 of FIG. 8 and S1140 of FIG. 11,which are a part of the operation of the terminal 200;

FIG. 11 is a flow chart showing S860, S880, S900 of FIG. 8 and S920,S950 of FIG. 9, which are a part of the operation of the terminal 200;

FIG. 12 is a diagram showing an example of input keys and a home screen;

FIG. 13 is a diagram showing an example of a cgi script;

FIG. 14 is a diagram showing an example of a remote control screen inthe terminal 200;

FIG. 15 is a sequence diagram explaining a first operational example;and

FIG. 16 is a sequence diagram explaining a second operational example.

DETAILED DESCRIPTION

FIG. 1 shows a block diagram of an electric configuration of an imageprocessing system 1. The image processing system 1 includes amultifunction peripheral (hereinbelow termed “MFP”) 10, and a terminal200 configured capable of communicating with the MFP 10.

<Configuration of MFP 10>

The MFP 10 has various functions, such as printing function, scanfunction, copy function, facsimile function, and the like. The MFP 10 isconfigured capable of executing processes related to these functionsaccording to a remote control from the terminal 200, which is installedwith a browser application (hereinbelow termed “browser app”) 212 b.

The MFP 10 is provided with a CPU 11, a flash memory 12, a RAM 13, inputkeys 15, an LCD 16, a touch panel 17, a scanner 18, a printer 19, an NCU20, a modem 21, and a wireless communication module 23. These membersare connected to each other via an input/output port 24. The CPU 11controls the respective functions endowed to the MFP 10, and therespective members connected to the input/output port 24 according tofixed values, programs, data stored in the RAM 13, or various signalssent and received through the NCU 20.

The flash memory 12 is a nonvolatile memory, which stores a controlprogram 12 a and the like for controlling operations of the MFP 10.Respective processes shown in flow charts of FIGS. 2 to 7 are processesthat the CPU 11 executes according to the control program 12 a. Further,the flash memory 12 stores a plurality of screen data representingplural types of screens that can be displayed on the LCD 16. The RAM 13is a rewritable volatile memory including a temporary area fortemporarily storing various types of data when the CPU 11 executes thecontrol program 12 a.

The input keys 15 are mechanical keys provided on a housing of the MFP10. In the embodiment explained herein, as shown in FIG. 12, a case willbe described in which the input keys 15 include a STOP key K1, a STARTkey K2, and a HOME key K3. The STOP key K1 is a key for stopping variousprocesses being executed in the MFP 10. The START key K2 is a key forstarting various processes. The HOME key K3 is a key for displaying ahome screen P1 on the LCD 16.

The LCD 16 is a liquid crystal display, and displays various screensthereon. A screen of the LCD 16 has the touch panel 17 provided tooverlap the LCD 16. A touch screen is thereby configured. The touchpanel 17 detects that a press operation is inputted when an indicatorsuch as a finger or a stick is brought close to or into contact with thescreen of the LCD 16, and outputs a press coordinate indicating apressed position. Further, when the indicator such as the finger or astick, which had been close to or in contact with the screen of the LCD16, is withdrawn away therefrom, the touch panel 17 detects that arelease operation is inputted, and outputs a release coordinateindicating a released position. The scanner 18 scans a document andconverts the same into image data. The printer 19 prints an image basedon image data on a recording medium sheet. The modem 21 modulates imagedata to be sent upon FAX transmission into transmittable signals andsends the same through the NCU 20, or demodulates signals inputtedthrough the NCU 20 from a telephone network (not shown) into image data.The NCU 20 connects the telephone network that is not shown and the MFP10, and controls connection states with the telephone network byconnecting or disconnecting its line according to instructions from themodem 21.

The wireless communication module 23 is an interface for performing awireless communication using a wireless LAN. In this embodiment, thecommunication performed by the wireless communication module 23 is awireless communication by a wireless LAN, complying to the standards ofIEEE 802.11b/g/n. In this embodiment, the wireless communication module23 connects with the terminal 200 using a wireless communication(hereinbelow termed “Wi-Fi communication”) complying to the Wi-Fi(registered trademark) standard under an infrastructure mode using anaccess point (hereinbelow termed “AP”) 50 being a relay device. In thedescription below, the communication carried out between the MFP 10 andthe terminal 200 is a Wi-Fi communication through the AP 50, unlessdescribed otherwise.

<Configuration of Terminal 200>

In this embodiment, a case will be described in which the terminal 200is a PC (personal computer). The terminal 200 primarily includes a CPU211, a flash memory 212, a RAM 213, input keys 215, an LCD 216, a touchpanel 217, a memory card interface (memory card I/F) 218, an audio input219, and a wireless communication module 223. These modules areconnected to each other via an input/output port 224. The CPU 211controls the respective members connected to the input/output port 224according to fixed values and programs stored in the flash memory 212.

The flash memory 212 is a rewritable nonvolatile memory. The flashmemory 212 stores an operating system 212 a and the browser app 212 b.The operating system 212 a is a basic software for realizing standardfunctions of the terminal 200. In this embodiment, Windows (registeredtrademark) OS is employed as an example of the operating system 212 a.The browser app 212 b is an application program for receiving HTMLdocuments and the like from a Web server and displaying the same.Notably, respective processes shown in flow charts of FIGS. 8 to 11 areprocesses executed by the CPU 211 according to the browser app 212 b.

The input keys 215 are mechanical keys provided on a housing of theterminal 200, and receive various set values and instructions from theuser. The input keys 215 include a keyboard 220. The LCD 216, the touchpanel 217, and the wireless communication module 223 perform similaroperations as the aforementioned LCD 16, touch panel 17, and wirelesscommunication module 23. The memory card I/F 218 is an interface towhich a rewritable nonvolatile memory card (not shown) is to be mounted,and controls data read and write operations of the memory card. Theaudio input 219 is an audio input device such as an internal microphone.

In this description, the “operating system” may be termed “OS”. Further,in this description, the CPU 211 executing applications or programs suchas the operating system may be referred to by the name of the program.For example, “the application” may mean “the CPU 211 executing theapplication”.

<Operation of Image Processing System 1>

In the image processing system 1 of FIG. 1, the MFP 10 functions as aWeb server, and the browser app 212 b of the terminal 200 functions as aclient. One of characteristics of the technique described herein is thatremote control of the MFP 10 using the terminal 200 is enabled by usingsuch a Web server and a client. In the technique described herein, ascreen including identical contents as a screen displayed on the LCD 16of the MFP 10 can be displayed with the browser app 212 b of theterminal 200 as a “virtual screen”. Further, operations inputted to thevirtual screen of the browser app 212 b can be inputted to the MFP 10.

<Operation of MFP 10>

An operation of the MFP 10 will be described with reference to FIGS. 2to 7. The processes of FIGS. 2 to 7 are started on condition that apreparation process for enabling the remote control is completed betweenthe terminal 200 and the MFP 10.

The preparation process will be described. The preparation processstarts with the user operating the MFP 10 to enable the remote control.Then, the user operates the terminal 200 to activate the browser app 212b, and instructs the terminal 200, in which the browser app 212 b hasbeen activated, to search for the remote control-enabled MFP 10. Theterminal 200 registers the MFP 10 as a target device for the remotecontrol in the terminal 200. The terminal 200 sends registrationinformation indicating that the registration has been made, an IPaddress of the terminal 200, and the like to the registered MFP 10through a Wi-Fi communication. Once these are received, the MFP 10establishes a communication link with the terminal 200. The preparationprocess is completed when this communication link is established. As aresult, the MFP 10 comes to be in a state of being capable of the remotecontrol from the terminal 200.

In S10, the CPU 11 displays the home screen on the LCD 16. FIG. 12 showsan example of the home screen P1. The home screen P1 includes buttonimages B1 to B3. The button images B1 to B3 are images respectively foraccepting an execution instruction for a FAX process, a copy process,and a scan process. Further, the button images B1 to B3 are imagesrespectively for accepting an input of a display switching instructionfor switching the home screen P1 to a FAX screen, a copy screen, and ascan screen. Hereinbelow, as an example thereof, the operation for acase where the home screen P1 is displayed on the LCD 16 will bedescribed.

In S15, the CPU 11 determines whether or not an http(s) request has beenreceived from the terminal 200. The http(s) request functions asinformation for requesting the MFP 10 to send screen data thatrepresents the screen being displayed on the LCD 16 of the MFP 10 to theterminal 200. When an affirmative determination is made in S15 (S15:YES), the CPU 11 proceeds to S20.

In S20, the CPU 11 executes a screen data sending process. After this,the CPU 11 returns to S15. The screen data sending process is a seriesof processes for sending the screen data and an html script for causingthe browser app 212 b of the terminal 200 to perform various operationsto the terminal 200. Contents of the screen data sending process will bedescribed later with reference to FIG. 3.

On the other hand, when a negative determination is made in S15 (S15:NO), the CPU 11 proceeds to S30. In S30, the CPU 11 determines whetheror not an http(s) cgi request including screen press information andpress coordinate information is received from the terminal 200. Thehttp(s) cgi request is information for requesting the MFP 10, that isthe Web server, to execute a program, and to return an execution resultof the program to the browser app 212 b that is the client. The screenpress information is information indicating that a position within thehome screen P1 displayed on the LCD 16 of the MFP 10 has been pressed bya remote operation from the terminal 200. The press coordinateinformation is information indicating the pressed position on the homescreen P1. When an affirmative determination is made in S30 (S30: YES),the CPU 11 proceeds to S40.

In S40, the CPU 11 executes a screen pressing process. The CPU 11 thenreturns to S15. The screen pressing process is a series of processes forexecuting processes according to the press coordinate information in theMFP 10 and to send an html script and screen data to the terminal 200.Contents of the screen pressing process will be described later withreference to FIG. 4.

On the other hand, when a negative determination is made in S30 (S30:NO), the CPU 11 proceeds to S50. In S50, the CPU 11 determines whetheror not an http(s) cgi request including release information and releasecoordinate information is received from the terminal 200. The releaseinformation is information indicating that a release operation has beeninputted to a position within the home screen P1 displayed in the LCD 16of the MFP 10 by a remote operation from the terminal 200. The releasecoordinate information is information indicating the position where theindicator that had been in contact was drawn away therefrom in the homescreen P1. When an affirmative determination is made in S50 (S50: YES),the CPU 11 proceeds to S60.

In S60, the CPU 11 executes a releasing process. The CPU 11 then returnsto S15. The releasing process is a series of processes for executingprocesses according to the release coordinate information in the MFP 10and to send an html script and screen data to the terminal 200. Contentsof the releasing process will be described later with reference to FIG.5.

On the other hand, when a negative determination is made in S50 (S50:NO), the CPU 11 proceeds to S70. In S70, the CPU 11 determines whetheror not a http(s) cgi request including virtual key press information isreceived from the terminal 200. The virtual key press information isinformation indicating that one of the input keys 15 provided in the MFP10 has been pressed by a remote operation from the terminal 200. When anaffirmative determination is made in S70 (S70: YES), the CPU 11 proceedsto S80.

In S80, the CPU 11 executes a key pressing process. The CPU 11 thenreturns to S15. The key pressing process is a series of processes forexecuting processes according to the pressed input key in the MFP 10 andto send an html script and screen data to the terminal 200. Contents ofthe key pressing process will be described later with reference to FIG.6.

On the other hand, when a negative determination is made in S70 (S70:NO), the CPU 11 proceeds to S90. In S90, the CPU 11 determines whetheror not a http(s) cgi request including press-release information andpress-release coordinate information is received from the terminal 200.The press-release information is information indicating that a positionwithin the home screen P1 displayed in the LCD 16 of the MFP 10 has beenpressed and released by remote operations from the terminal 200. Thepress-release coordinate information is information indicating theposition where the pressing and the releasing had taken place. When anaffirmative determination is made in S90 (S90: YES), the CPU 11 proceedsto S100.

In S100, the CPU 11 executes a press-release process. The CPU 11 thenreturns to S15. The press-release process is a series of processes forexecuting processes according to the press-release coordinateinformation in the MFP 10 and to send an html script and screen data tothe terminal 200. Contents of the press-release process will bedescribed later with reference to FIG. 7.

On the other hand, when a negative determination is made in S90 (S90:NO), the CPU 11 proceeds to S110. In S110, the CPU 11 determines whetheror not an http(s) cgi request including text information is receivedfrom the terminal 200. The text information is information indicating aletter string inputted in the terminal 200. When a negativedetermination is made in S110 (S110: NO), the CPU 11 returns to S15, andwhen an affirmative determination is made therein (S110: YES), the CPU11 proceeds to S120.

In S120, the CPU 11 determines whether or not a screen being currentlydisplayed on the LCD 16 is a password input screen. The password inputscreen is a screen for accepting an input of a password letter string.The password input screen may include a screen keyboard image providedwith a plurality of keys. When a negative determination is made in S120(S120: NO), the CPU 11 returns to S15 and when an affirmativedetermination is made therein (S120: YES), the CPU 11 proceeds to S130.

In S130, the CPU 11 executes a text displaying process. In the textdisplaying process, the letter string indicated by the text informationreceived in S110 is displayed in the password input screen. Due to this,the input of the password letter string can be accepted without usingthe screen keyboard image. Thus, which key had been pressed is not shownto the user by the screen keyboard image. Password is prevented frombeing exposed.

In S140, the CPU 11 generates screen data for a screen after the letterstring has been displayed, and stores the same in the RAM 13. The screendata is for example bitmap type data. Further, the CPU 11 sends ahttp(s) cgi response to the terminal 200.

<Screen Data Sending Process>

The contents of the screen data sending process of S20 will be describedwith reference to FIG. 3. In S210 to S273 of the screen data sendingprocess, a script to be included in a body of the http(s) response isgenerated. This procedure will be described below in detail.

In S210, the CPU 11 executes a process to generate a virtual keydisplaying script. The virtual key displaying script is a cgi script forinstructing the browser app 212 b of the terminal 200 to display virtualkeys. The virtual keys virtually show the mechanical keys included inthe input keys 15, such as the STOP key K1, the START key K2, and theHOME key K3, on screen. FIG. 13 shows an example of the cgi script forcausing the browser app 212 b to display the STOP key K1.

In S220, the CPU 11 executes a process to generate a virtual keypressing process script. The virtual key pressing process script is acgi script for instructing the terminal 200 to send virtual key pressinformation to the MFP 10 when an operation to press the virtual keys inthe browser app 212 b is accepted in the terminal 200.

In S230, the CPU 11 determines whether or not the MFP 10 is set in abidirectional communication mode. The bidirectional communication modeis a mode by which screen data representing the displayed screen of theLCD 16 is sent periodically to the terminal 200. The setting of thebidirectional communication mode may freely be set by the user. Due tothis, even when the screen being displayed on the LCD 16 of the MFP 10has changed, the virtual screen displayed by the browser app 212 b ofthe terminal 200 can be changed without delay. When an affirmativedetermination is made in S230 (S230: YES), the CPU 11 proceeds to S250.

In S250, the CPU 11 executes a process to generate a periodic updatescript. The periodic update script is a cgi script for instructing theterminal 200 to periodically send an http(s) request that requests forscreen data to the MFP 10. The CPU 11 then proceeds to S260.

On the other hand, when a negative determination is made in S230 (S230:NO), the CPU 11 proceeds to S240. In S240, the CPU 11 executes a processto generate a screen data requesting script. The screen data requestingscript is a cgi script for instructing the terminal 200 to send thehttp(s) request requesting the screen data to the MFP 10 on conditionthat an input operation is accepted in the terminal 200 at a positionwithin the virtual screen that the browser app 212 b is displaying. Dueto this, the virtual screen can be updated when an input operation isperformed on the virtual screen. Thus, identical contents can bedisplayed on the screen of the MFP 10 and on the virtual screen of theterminal 200. The CPU 11 then proceeds to S260.

In S260, the CPU 11 executes a process to generate a screen pressingprocess script and a releasing process script. The screen pressingprocess script is a cgi script for instructing the terminal 200 to sendan http(s) cgi request including the screen press information and thepress coordinate information to the MFP 10 on condition that a pressoperation is accepted in the terminal 200 at a position within thevirtual screen that the browser app 212 b is displaying. Similarly, thereleasing process script is a cgi script for instructing the terminal200 to send an http(s) cgi request including the release information andthe release coordinate information to the MFP 10 on condition that arelease operation is accepted in the terminal 200.

In S270, the CPU 11 executes a process to generate a press-releaseprocess script. The press-release process script is a script that isgenerated when the browser app 212 b is displaying the virtual screen ofthe password input screen including the screen keyboard image. Thepress-release process script is a cgi script for instructing theterminal 200 to send an http(s) cgi request including the press-releaseinformation and the press-release coordinate information to the MFP 10,on condition that a press operation and a release operation to a keyimage within the screen keyboard image are accepted in the terminal 200.

In S273, the CPU 11 executes a process to generate a text processscript. The text process script is a cgi script for instructing theterminal 200 to send the text information indicating an inputted letterstring to the MFP 20 when an operation to input the letter string to atext box displayed on the virtual screen is accepted in the terminal200.

In S300, the CPU 11 executes screen data reading process. Specifically,screen data stored in the RAM 13 in processes related to S450, S560,S650, and S740 to be described later is read out from the RAM 13.

In S310, the CPU 11 sends the http(s) response to the terminal 200.Further, the CPU 11 sends the screen data read in S300 to the terminal200. The body of the http(s) response includes various cgi scriptsgenerated in S210 to S273. Further, a header of the http(s) responseincludes information indicating that the http(s) request received in S15has succeeded.

<Screen Pressing Process>

The contents of the screen pressing process of S40 will be describedwith reference to FIG. 4. In S410, the CPU 11 executes conversionprocess of a coordinate indicated by the press coordinate informationreceived in S30. The conversion process is a process for matching thepressed position on the virtual screen of the browser app 212 b and apressed position on the LCD 16 of the MFP 10. For example, in theconversion process, a relative coordinate indicating the pressedposition on the virtual screen of the browser app 212 b may be convertedto an absolute coordinate indicating the pressed position on the LCD 16of the MFP 10. In S420, the CPU 11 temporarily stores the convertedpress coordinate in the RAM 13.

In S430, the CPU 11 determines whether or not the stored presscoordinate is within a display area of one of the button images B1 toB3. When an affirmative determination is made (S430: YES), the CPU 11proceeds to S435. In S435, the CPU 11 determines whether or not thebutton image, within the display area of which the press coordinate isexisting, is a button image for switching the screen being currentlydisplayed on the LCD 16. When an affirmative determination is made(S435: YES), the CPU 11 proceeds to S440.

In S440, the CPU 11 switches a display configuration of the button imagewithin the display area of which the press coordinate exists, to apressed configuration indicating that this button has been pressed. Asan example of the pressed configuration, a configuration that changes acolor of the button image, or a configuration that changes a shape ofthe button image to a shape that is dented due to having been pressed inmay be exemplified.

In S450, the CPU 11 generates screen data for the home screen P1 inwhich the pressed button image is displayed in the pressedconfiguration, and stores the same in the RAM 13. In S460, the CPU 11sends an http(s) cgi response to the terminal 200. The header of thehttp(s) cgi response includes information indicating that the http(s)request received in S30 has succeeded. Further, the body of the http(s)cgi response includes a screen update script. The screen update scriptis a cgi script for instructing the terminal 200 to send an http(s)request requesting screen update to the MFP 10.

On the other hand, when a negative determination is made in S430 or S435(S430: NO, S435: NO), the CPU 11 proceeds to S470. In S470, the CPU 11sends an http(s) cgi response to the terminal 200. The header of thishttp(s) cgi response includes the information indicating that thehttp(s) request received in S30 has succeeded, but the body thereof doesnot include the screen update script.

<Releasing Process>

The contents of the releasing process of S60 will be described withreference to FIG. 5. In S510, the CPU 11 determines whether or not theMFP 10 is set in a press-release coordinate matching mode. Thepress-release coordinate matching mode is a mode for bringing therelease coordinate to match the press coordinate when the presscoordinate and the release coordinate are different. In thepress-release coordinate matching mode, the processes corresponding tothe press coordinate can surely be executed even if the press coordinateand the release coordinate are different. By using the press-releasecoordinate matching mode, incorrect operations can be prevented fromtaking place. Setting to turn on or off the press-release coordinatematching mode may be freely enabled to the user.

When a negative determination is made in S510 (S510: NO), the CPU 11proceeds to S535, and when an affirmative determination is made therein(S510: YES), the CPU 11 proceeds to S520. In S520, the CPU 11 sets therelease coordinate to match the press coordinate. Then, the CPU 11proceeds to S535. In S535, the CPU 11 temporarily stores the releasecoordinate in the RAM 13.

In S540, the CPU 11 determines whether or not the stored releasecoordinate is within the area of one of the button images B1 to B3. Whenan affirmative determination is made therein (S540: YES), the CPU 11proceeds to S545. In S545, the CPU 11 determines whether or not thebutton image, within the display area of which the release coordinate isexisting, is a button image for switching the screen being currentlydisplayed on the LCD 16. When an affirmative determination is made(S545: YES), the CPU 11 proceeds to S550.

In S550, the CPU 11 executes a screen switching process. Specifically,it switches to a screen in which the release coordinate is associatedwith the button image within the display area of which the releasecoordinate is existing. Due to this, when the button image is pressed onthe virtual screen of the terminal 200, the pressed button image can bepresented in the pressed configuration (S440). Further, when theindicator is released from the pressed button image, the screen can beswitched (S550)

In S560, the CPU 11 generates screen data for the screen after theswitching in S550, and stores the same in the RAM 13.

The contents of the processes of S570 are same as the contents of theprocesses of S460 as aforementioned. On the other hand, when a negativedetermination is made in S540 or S545 (S540: NO, S545: NO), the CPU 11proceeds to S580. The contents of the processes of S580 are same as thecontents of the processes of S470 as aforementioned.

<Key Pressing Process>

The contents of the key pressing process of S80 will be described withreference to FIG. 6. In S610, the CPU 11 identifies which one of theSTOP key K1 to HOME key K3 has been pressed by remote operation. InS620, the CPU 11 determines whether or not the key pressed by the remoteoperation is available in the screen being currently displayed on theLCD 16. An example of a case where this key is not available is when theHOME key K3 is pressed by the remote operation when the home screen P1is already being displayed. When an affirmative determination is made(S620: YES), the CPU 11 proceeds to S630.

In S630, the CPU 11 determines whether or not the pressed key is animage for switching the screen being currently displayed on the LCD 16.When an affirmative determination is made (S630: YES), the CPU 11proceeds to S640. In S640, the CPU 11 executes the screen switchingprocess. Specifically, it switches to a screen associated with thepressed key. Due to this, the mechanical keys provided in the MFP 10become available to being remotely operated from the terminal 200.

In S650, the CPU 11 generates screen for the screen after the switchingin S640, and stores the same in the RAM 13. The contents of theprocesses of S660 are same as the contents of the processes of S460 andS570 as aforementioned. On the other hand, when a negative determinationis made in S620 or S630 (S620: NO, S630: NO), the CPU 11 proceeds toS670. The contents of the processes of S670 are same as the contents ofthe processes of S470 and S580 as aforementioned.

<Press-Release Process>

The contents of the press-release process of S100 will be described withreference to FIG. 7. In S710, the CPU 11 executes the conversion processon the coordinate indicated by the press-release coordinate informationreceived in S90. The contents of the conversion process are describedearlier in S410.

The contents of the processes of S715, S720, S725, S730, S740, S750, andS760 are same as the contents of the processes of S535, S540, S545,S550, S560, S570, and S580 as aforementioned. In the screen switchingprocess of S730, the pressing process and the releasing process areexecuted simultaneously to the button image within which display areathe press-release coordinate exists. Due to this, switching to thescreen associated with the button image within which display area thepress-release coordinate exists can be performed, without switching thedisplay configuration of the button image to the pressed configuration.

<Operation of Terminal 200>

An operation of the terminal 200 will be described with reference toFIGS. 8 to 11. Processes of FIGS. 8 to 11 are started on condition thatthe aforementioned preparation process has been completed. In S800 ofFIG. 8, the CPU 11 displays a remote control screen on the LCD 216. FIG.14 shows an example of a remote control screen C1. The remote controlscreen C1 includes a virtual screen PV1 and virtual key images KV1 toKV3. In the example of FIG. 14, the virtual screen PV1 is a screen withidentical contents as the home screen P1 in FIG. 12. Each of the virtualkey images KV1 to KV3 is an image corresponding to one of the STOP keyK1 to HOME key K3. The virtual key images KV1 to KV3 virtually show themechanical keys. Hereinbelow, as an example, the operation in a casewhere the remote control screen C1 is displayed on the LCD 216 will bedescribed.

In S810, the CPU 211 determines whether or not the MFP 10 is set in thebidirectional communication mode. When a negative determination is made(S810: NO), the CPU 211 proceeds to S840, and when an affirmativedetermination is made (S810: YES), the CPU 211 proceeds to S820.

In S820, the CPU 211 determines whether or not a predetermined time haselapsed since a screen updating process of S830 was previously executed.When a negative determination is made (S820: NO), the CPU 211 proceedsto S840, and when an affirmative determination is made (S820: YES), theCPU 211 proceeds to S830. In S830, the CPU 211 executes the screenupdating process. Due to this, since the screen updating process can beexecuted periodically, the screen, the identical contents can bedisplayed on the screen of the MFP 10 and on the virtual screen of theterminal 200.

Contents of the screen updating process will be described with referenceto FIG. 10. In S1010, the CPU 211 sends an http(s) request to the MFP10. In S1020, the CPU 211 receives an http(s) response and screen datafrom the MFP 10.

In S1030, the CPU 211 executes the various cgi scripts included in thebody of the http(s) response. Examples of the cgi scripts are describedin S210 to S273. In S1040, the CPU 211 updates the virtual screen beingdisplayed on the remote control screen C1 according to the screen datareceived in S1020. Due to this, the screen updating process iscompleted.

The description of FIG. 8 will be continued. In S840, the CPU 211determines whether or not the virtual screen being currently displayedis the password input screen. When a negative determination is made(S840: NO), the CPU 211 proceeds to S850. In S850, the CPU 211determines whether or not a position within the virtual screen ispressed. When a negative determination is made (S850: NO), the CPU 211proceeds to S870, and when an affirmative determination is made (S850:YES), the CPU 211 proceeds to S860.

In S860, the CPU 211 executes an http(s) cgi request sending process.Contents of the http(s) cgi request sending process will be describedwith reference to FIG. 11. In S1100, the CPU 211 generates an http(s)cgi request corresponding to the operation inputted to the touch panel217 of the terminal 200. When the operation to press a position withinthe virtual screen is inputted, the http(s) cgi request including thescreen press information and the press coordinate information isgenerated. In S1110, the CPU 211 sends the generated http(s) cgi requestto the MFP 10. In S1120, the CPU 211 receives the http(s) cgi responsefrom the MFP 10. In S1130, the CPU 211 determines whether or not thescreen update script is included in the body of the received http(s) cgiresponse. When a negative determination is made (S1130: NO), the http(s)cgi request sending process is terminated, and when an affirmativedetermination is made (S1130: YES), the CPU 211 proceeds to S1140. InS1140, the CPU 211 executes the screen updating process. The contents ofthe screen updating process are described earlier with reference to FIG.10.

The description of FIG. 8 will be continued. In S870, the CPU 211determines whether or not the indicator that was in contact with theposition in the virtual screen has been released therefrom. When anegative determination is made (S870: NO), the CPU 211 proceeds to S890,and when an affirmative determination is made (S870: YES), the CPU 211proceeds to S880. In S880, the CPU 211 executes the http(s) cgi requestsending process. Due to this, the http(s) cgi request including therelease information and the release coordinate information is sent tothe MFP 10. The contents of the http(s) cgi request sending process aredescribed earlier with reference to FIG. 11.

In S890, the CPU 211 determines whether or not a tap input is made toone of the virtual key images KV1 to KV3. When a negative determinationis made (S890: NO), the CPU 211 returns to S810, and when an affirmativedetermination is made (S890: YES), the CPU 211 proceeds to S900. InS900, the CPU 211 executes the http(s) cgi request sending process. Dueto this, the http(s) cgi request including the virtual key pressinformation is sent to the MFP 10. The contents of the http(s) cgirequest sending process are described earlier with reference to FIG. 11.

On the other hand, in S840, when an affirmative determination is made(S840: YES), the CPU 211 proceeds to S910. In S910, the CPU 211determines which key image within the screen keyboard image included inthe password input screen received a tap input. When a negativedetermination is made (S910: NO), the CPU 211 proceeds to S930, and whenan affirmative determination is made (S910: YES), the CPU 211 proceedsto S920. In S920, the CPU 211 executes the http(s) cgi request sendingprocess. Due to this, the http(s) cgi request including thepress-release information and the press-release coordinate informationis sent to the MFP 10. The contents of the http(s) cgi request sendingprocess are described earlier with reference to FIG. 11.

In S930, the CPU 211 determines whether or not one of the mechanicalkeys in the keyboard 220 is tapped. When a negative determination ismade (S930: NO), the CPU 211 returns to S810, and when an affirmativedetermination is made (S930: YES), the CPU 211 proceeds to S940. InS940, the CPU 211 generates the text information indicating the letterstring inputted through the keyboard 220. In S950, the CPU 211 executesthe http(s) cgi request sending process. Due to this, the http(s) cgirequest including the text information is sent to the MFP 10. Thecontents of the http(s) cgi request sending process are describedearlier with reference to FIG. 11.

First Operational Example

A first operational example will be described with reference to FIG. 15.In the first operational example, a case will be described in which theuser is tapping on the button image B1 in the virtual screen in theterminal 200 as an initial state. In this case, the LCD 16 of the MFP 10is displaying the home screen P1 in which the button image B1 in thepressed configuration. Further, the remote control screen C1 of theterminal 200 is displaying the virtual screen PV1, in which the buttonimage B1 is being displayed in the pressed configuration.

When the user releases a finger from the button image B1 in the virtualscreen PV1 (S870: YES), the http(s) cgi request including the releaseinformation and the release coordinate information is sent to the MFP 10(S880). When the http(s) cgi request is received (S50: YES), the MFP 10switches the screen to be displayed to the FAX sending screen P2corresponding to the button image B1 (S550). Further, the MFP 10 storesthe screen data of the FAX sending screen P2 in the RAM 13 (S560). TheMFP 10 sends the http(s) cgi response including the screen update scriptto the terminal 200 (S570). The terminal 200 receives this http(s) cgiresponse (S1120).

Since the screen update script is included (S1130: YES), the terminal200 sends the http(s) request to the MFP 10 (S1140 and S1010). When thehttp(s) request is received (S15: YES), the MFP 10 generates variousscripts (S210 to S273). The MFP 10 sends the http(s) response includingthese various scripts, and the screen data of the FAX sending screen P2to the terminal 200 (S310). The terminal 200 receives this http(s)response and the screen data of the FAX sending screen P2 from the MFP10 (S1020), and executes the various cgi scripts (S1030). Further, theterminal 200 updates the virtual screen PV1 to a virtual screen PV2according to the screen data of the FAX sending screen P2 (S1040). Dueto this, the virtual screen PV2 including the same contents as the FAXsending screen P2 being displayed on the MFP 10 can be displayed in theterminal 200.

Effects will be described. The MFP 10 can receive the coordinateinformation from the terminal 200 (S50), switch the screen according tothe coordinate information (S550), and send the screen data representingthe screen after the switching to the terminal 200 (S310). Due to this,there is no need to communicate various types of dedicated commands forremote control between the MFP 10 and the terminal 200 when the screenof the MFP 10 is to be remotely controlled from the terminal 200. A sizeof the control program 12 a to be stored in the flash memory 12 of theMFP 10 can be suppressed.

The MFP 10 can be caused to function as the Web server, and the browserapp 212 b of the terminal 200 can be caused to function as a client. Dueto this, since the remote control can be performed based on httpprotocols, there is no need to use programs and commands dedicated tothe remote control. The size of the control program 12 a andcommunication load upon the remote control can be suppressed.

In response to the screen having been switched in the MFP 10 (S550), thescreen data representing the screen after the switching is generated(S560), and is sent to the terminal 200 (S310). Due to this, theidentical contents can be displayed on the screen of the MFP 10 and onthe virtual screen of the terminal 200.

When the screen is switched in the MFP 10 (S550), the http(s) cgiresponse including the screen update script can be sent to the terminal200 (S570). Due to this, it becomes possible to cause the terminal 200to execute the screen updating process (S1140) in response to the screenbeing switched in the MFP 10. Even if the MFP 10 is not set in thebidirectional communication mode (S230: NO), the displayed contents ofthe virtual screen of the terminal 200 can always match with thedisplayed contents of the screen of the MFP 10.

Second Operational Example

A second operational example will be described with reference to FIG.16. In the second operational example, the LCD 16 of the MFP 10 isdisplaying a first password input screen P3 including the screenkeyboard image KB1 and a text input BOX image TB1 in the initial state.Further, the remote control screen C1 of the terminal 200 is displayinga virtual screen PV3 including the identical contents as the firstpassword input screen P3.

When the user taps on one of the key images in the screen keyboard imageincluded in the virtual screen PV3 (S910: YES), the http(s) cgi requestincluding the press-release information and the press-release coordinateinformation is sent to the MFP 10 (S920). When the http(s) cgi requestis received (S90: YES), the MFP 10 executes the screen switching process(S730), and switches to a second password input screen P3 a. The secondpassword input screen P3 a is a screen in which asterisks indicatingthat the password has been inputted. In the screen switching process(S730), the pressing process and the releasing process aresimultaneously executed. Due to this, the input of the password letterstring can be accepted without changing the key image on the screenkeyboard image KB1 on the password input screen P3 to the pressedconfiguration. Since which key image was operated can be kept hiddenfrom the user of the MFP 10, the password exposure can be prevented.

Further, the MFP 10 stores screen data of the second password inputscreen P3 a in the RAM 13 (S740). The MFP 10 sends the http(s) cgiresponse including the screen update script to the terminal 200 (S750).The terminal 200 receives the http(s) cgi response (S1120). Theprocesses hereafter from S1140 to S1040 are identical to contents of theprocesses shown in an area R1 of FIG. 15. Due to this, a virtual screenPV3 a having identical contents as the second password input screen P3 abeing displayed on the MFP 10 can be displayed on the terminal 200.

Furthermore, it is to be understood that the technical elementsdescribed in the present specification and the drawings exhibittechnical usefulness solely or in various combinations thereof and shallnot be limited to the combinations described in the claims at the timeof filing. The techniques illustrated in the present specification andthe drawings are to achieve a plurality of objectives at the same time,and technical usefulness is exhibited by attaining any one of suchobjectives. Modifications will be described below.

<Variation>

In the screen data reading process of S300, a determination may be madeon whether or not the screen being currently displayed on the LCD 16 isthe password input screen. When an affirmative determination is made,dummy screen data may be read out instead of the screen data stored inthe RAM 13. The dummy screen data is data for displaying a dummy screenfor preventing the contents of the password inputted in the terminal 200from being displayed on the LCD 16 of the MFP 10. Examples of the dummyscreen may have a configuration that darkens an entirety of the screen,or that blurs displayed contents. The dummy screen data may be stored inthe flash memory 12 in advance. Due to this, the dummy screen can bedisplayed in the LCD 216 when the virtual screen is updated (S1040) inthe terminal 200.

In the above embodiment, the PC terminal was exemplified as the terminal200 for performing the remote control on the MFP 10 by sending textdata, however, it may be a tablet terminal, a smartphone, a cell phone,a digital camera, or a portable music player. In the terminal 200, theinput operation was accepted by the touch panel 217, however, nolimitation is made to this configuration. The input operation may beaccepted by an input device such as a mouse. In this case, the pressoperation may be accepted by clicking on a left click button, and therelease operation may be accepted by releasing the left click button.

Further, in the above embodiment, the case in which the communicationbetween the MFP 10 and the terminal 200 is the Wi-Fi communication underthe infrastructure mode using the AP 50, however, it may be of othercommunication methods, such as a Wi-Fi communication under an adhoc modewhich is a direct connection, Bluetooth (registered trademark), cellulartelephone network (3G, 4G, etc.), or the Internet.

The STOP key K1, the START key K2, and the HOME key K3 were exemplifiedas examples of the input keys 15, however, no limitation is made to thisconfiguration. They may be other types of keys, such as a cancel key ora numeric keypad.

In the process flow of FIGS. 2, S30 and S40 may be omitted. S70 and S80may be omitted. S90 and S100 may be omitted. S110 to S140 may beomitted. In the screen data sending process (FIG. 3), S230 to S250 maybe omitted. In the releasing process (FIG. 5), S510 and S520 may beomitted. According to the above, in general terms, the MFP 10 simplyneeds to be capable of executing at least displaying a screen includinga first image, generating screen data, sending the screen data to theterminal 200, receiving coordinate information from the terminal 200,determining whether or not a position indicated by the coordinateinformation is within a specific display area within the first image,and switching the screen when the determined position is within thespecific display area. As specific examples thereof, a multifunctionperipheral 100 simply needs to execute at least one of S10, S440, S550,S640, and S730, at least one of S450, S560, S650, and S740, as well asS310, S50, S540, and S550.

The terminal 200 is an example of an information processing device; theLCD 16 and the touch panel 17 are examples of a touch screen; the MFP 10is an example of an image processing device; the button images B1 to B3are examples of a first image; the CPU executing S10, S440, S550, S640,and S730 is an example of displaying a first display screen; the homescreen P1 is an example of the first display screen; the FAX sendingscreen P2 is an example of a second display screen; the LCD 216 is anexample of a display; the CPU executing S450, S560, S650, and S740 is anexample of generating first screen data; the http(s) request is anexample of first request information; the CPU executing S310 is anexample of sending the generated first screen data; the CPU executingS50 is an example of receiving coordinate information; the CPU executingS540 is an example of determining whether or not a position indicated bythe coordinate information is within a display area of the first image;the CPU executing S550 is an example of switching to the second displayscreen; the http(s) response is an example of first responseinformation; the CPU executing S210 to S300 is an example of generatingfirst response information; the screen pressing process script and thereleasing process script are examples of first instruction information;the http(s) cgi response is an example of second response information;the CPU executing S570 is an example of sending second responseinformation; the screen update script is an example of secondinstruction information; the periodic update script is an example ofthird instruction information; the screen data requesting script is anexample of fourth instruction information; the STOP key K1 to HOME keyK3 are examples of an input module; the virtual key pressing processscript is an example of fifth instruction information; the CPU executingS440 is an example of switching a display configuration of the firstimage; the press-release process script is an example of sixthinstruction information; the CPU executing S730 is an example ofswitching the first display screen without switching a displayconfiguration of a plurality of keys; and the text process script is anexample of seventh instruction information.

What is claimed is:
 1. An image processing device comprising: acommunication interface for executing communication with an informationprocessing device; a touch screen; a memory storing computer-readableinstructions; and a controller, wherein the computer-readableinstructions, when executed by the controller, cause the imageprocessing device to perform: displaying a first display screenincluding a first image on the touch screen, the first image being animage for accepting an input of a display switching instruction toswitch the first display screen to a second display screen; generatingfirst screen data, which represents the first display screen displayedin the displaying, and which enables a display of the informationprocessing device to display the first display screen; sending thegenerated first screen data to the information processing device via thecommunication interface in a case where first request information isreceived via the communication interface from the information processingdevice; receiving coordinate information via the communication interfacefrom the information processing device, the coordinate informationindicating a position within the first display screen where an inputoperation has been inputted; determining whether or not the positionindicated by the coordinate information is within a display area of thefirst image; and switching to the second display screen associated withthe first image in a case where the position indicated by the coordinateinformation is within the display area of the first image.
 2. The imageprocessing device according to claim 1, wherein the computer-readableinstructions, when executed by the controller, further cause the imageprocessing device to perform: generating first response information inthe case where the first request information is received; and sendingthe generated first response information via the communication interfaceto the information processing device as a response to the first requestinformation, wherein the first response information includes firstinstruction information that instructs the information processing deviceto receive and send the coordinate information to the image processingdevice when the information processing device accepts the inputoperation to a position within the first display screen, and thereceiving receives the coordinate information sent from the informationprocessing device in accordance with the first instruction information.3. The image processing device according to claim 1, wherein thecomputer-readable instructions, when executed by the controller, furthercause the image processing device to perform: generating second screendata, which represents the second display screen to be displayed afterswitching from the first display screen in the switching; and sendingthe generated second screen data to the information processing devicevia the communication interface.
 4. The image processing deviceaccording to claim 3, wherein the computer-readable instructions, whenexecuted by the controller, further cause the image processing device toperform: sending second response information to the informationprocessing device via the communication interface as a response to thecoordinate information, when the coordinate information is received inthe receiving, wherein the second response information includes secondinstruction information that instructs the information processing deviceto send the first request information to the image processing device,and the sending of the second screen data includes sending the secondscreen data to the information processing device in the case where thefirst request information, which was sent from the informationprocessing device according to the second instruction information, isreceived.
 5. The image processing device according to claim 1, whereinthe computer-readable instructions, when executed by the controller,further cause the image processing device to perform: generating firstresponse information in the case where the first request information isreceived, wherein the first response information includes thirdinstruction information that instructs the information processing deviceto periodically send the first request information to the imageprocessing device, and the sending of the first screen data includessending the first screen data to the information processing device inthe case where the first request information, which was sent from theinformation processing device according to the third instructioninformation, is received.
 6. The image processing device according toclaim 1, wherein the computer-readable instructions, when executed bythe controller, further cause the image processing device to perform:generating first response information in the case where the firstrequest information is received, wherein the first response informationincludes fourth instruction information that instructs the informationprocessing device to send the first request information to the imageprocessing device on condition that the information processing deviceaccepted the input operation to a position within the first displayscreen, and the sending of the first screen data includes sending thefirst screen data to the information processing device in the case wherethe first request information, which was sent from the informationprocessing device according to the fourth instruction information, isreceived.
 7. The image processing device according to claim 1, furthercomprising: an input module configured separately from the touch screen,wherein the computer-readable instructions, when executed by thecontroller, further cause the image processing device to perform:generating first response information in the case where the firstrequest information is received, wherein the first response informationincludes fifth instruction information that instructs the informationprocessing device to accept an input operation to the input module inthe information processing device, and that further instructs theinformation processing device to send first information to the imageprocessing device when the input operation to the input module isaccepted in the information processing device; and switching the firstdisplay screen in a case where the first information sent from theinformation processing device according to the fifth instructioninformation is received via the communication interface.
 8. The imageprocessing device according to claim 1, wherein the input operationincludes: a first operation for bringing an indicator into contact orclose to the touch screen; and a second operation for releasing theindicator in contact or close to the touch screen away from the touchscreen, the computer-readable instructions, when executed by thecontroller, further cause the image processing device to perform:switching a display configuration of the first image in a case where thecoordinate information inputted by the first operation is within thedisplay area of the first image, and the switching to the second displayscreen includes switching the first display screen in a case where thecoordinate information inputted by the second operation is within thedisplay area of the first image.
 9. The image processing deviceaccording to claim 8, wherein the first image is a screen keyboard imageincluding a plurality of key images for inputting a letter string, thecomputer-readable instructions, when executed by the controller, furthercause the image processing device to perform: generating first responseinformation in the case where the first request information is received,wherein the first response information includes sixth instructioninformation that instructs the information processing device to receiveand send the coordinate information in a case where the first operationand the second operation are accepted by one of the plurality of keyimages; and switching the first display screen without switching adisplay configuration of the plurality of keys in a case where thecoordinate information is sent from the information processing deviceaccording to the sixth instruction information.
 10. The image processingdevice according to claim 1, wherein the first image is a screenkeyboard image including a plurality of key images for inputting aletter string, the computer-readable instructions, when executed by thecontroller, further cause the image processing device to perform:generating first response information in the case where the firstrequest information is received, wherein the first response informationincludes seventh instruction information that instructs the informationprocessing device to send letter string information, in a case where anoperation to input the letter string is accepted in the informationprocessing device, and the letter string information including theinputted letter string; and receiving the letter string informationwithout switching a display configuration of the plurality of keyimages, when the letter string information which was sent from theinformation processing device according to the seventh instructioninformation is received.
 11. The image processing device according toclaim 1, wherein the first request information is an http request. 12.The image processing device according to claim 2, wherein the firstresponse information is an http response, and the first instructioninformation is a script included in a body of the http response.
 13. Anon-transitory computer-readable recording medium storingcomputer-readable instructions for an image processing device thatcomprises: a communication interface for executing communication with aninformation processing device; a touch screen; and a controller, thecomputer-readable instructions, when executed by a controller of theimage processing device, causing the information processing device toperform: displaying a first display screen including a first image onthe touch screen, the first image being an image for accepting an inputof a display switching instruction to switch the first display screen toa second display screen; generating first screen data, which representsthe first display screen displayed in the displaying, and which enablesa display of the information processing device to display the firstdisplay screen; sending the generated first screen data to theinformation processing device via the communication interface in a casewhere first request information is received via the communicationinterface from the information processing device; receiving coordinateinformation via the communication interface from the informationprocessing device, the coordinate information indicating a positionwithin the first display screen where an input operation has beeninputted; determining whether or not the position indicated by thecoordinate information is within a display area of the first image; andswitching to the second display screen associated with the first imagein a case where the position indicated by the coordinate information iswithin the display area of the first image.
 14. An image processingsystem comprising an image processing device and an informationprocessing device, the image processing device comprising a firstcommunication interface and a touch screen, and the informationprocessing device comprising a second communication interface and adisplay, wherein the image processing device performs: displaying afirst display screen including a first image on the touch screen, thefirst image being an image for accepting an input of a display switchinginstruction to switch the first display screen to a second displayscreen; and generating first screen data, which represents the firstdisplay screen displayed in the displaying, and which enables a displayof the information processing device to display the first displayscreen, the information processing device performs: sending firstrequest information to the image processing device via the secondcommunication interface, the image processing device performs: sendingthe generated first screen data to the information processing device viathe first communication interface in a case where first requestinformation is received via the first communication interface from theinformation processing device; the information processing deviceperforms: displaying the first display screen indicated by the firstscreen data on the display when the first screen data is received fromthe image processing device via the second communication interface; andsending coordinate information to the image processing device via thesecond communication interface when an input operation to a positionwithin the first display screen is accepted, the coordinate informationindicating the position where the input operation has been inputted, theimage processing device performs: receiving the coordinate informationvia the first communication interface from the information processingdevice; determining whether or not the position indicated by thecoordinate information is within a display area of the first image; andswitching to the second display screen associated with the first imagein a case where the position indicated by the coordinate information iswithin the display area of the first image.